User control interface for interactive digital television

ABSTRACT

A method of controlling a television increasing a control function when a user-movable object is on one side of a line displayed on a layout, and decreasing the control function when the user-movable object is on the other side of the line. The method may involve movements in one, two, or three dimensions.

This application claims priority under 35 USC 119 to U.S. ProvisionalApplication 61/253,601, filed Oct. 21, 2009, which is incorporated byreference in its entirety.

BACKGROUND OF THE INVENTION

The present inventions relate to interactive television, and to thedisplay on a television screen of video and other content communicatedover the Internet.

Interactive television (iTV) is television or video programming thatincorporates interactivity. Interactive television is used as anumbrella term for the convergence of television with digital mediatechnologies including Internet communications. Television and Internetcontent are viewed over similar display devices, but have profounddifferences. The Internet represents a two-way medium that carrieslargely static content based upon point-to-point distribution.Television remains primarily a one-way medium with dynamic contentdistributed in point-to-multipoint methods. Interactive television canbe considered a combination of these systems, including certain featuresof each system in a hybrid medium. Interactive television combines therich, dynamic content of television with the personalization andresponsiveness of the Internet.

Internet and television may be merged by simply putting Internet contenton a television screen, or conversely by viewing television content on acomputer. The latter process is more easily accomplished, and is inwidespread use. With proper hardware television programs and other videocontent can be successfully viewed on a personal computer screen. On theother hand, putting Web page from a computer browser directly on atelevision screen is generally not satisfactory to the user. Web contentis typically viewed by a single user in close proximity to a personalcomputer screen, sometimes called the “one foot experience”. Thepersonal computer user interface can be called “lean forward”,signifying an interactive experience with users who are actively engagedwith activities on the screen. Conversely, television content is viewedat far greater distances, sometimes called the “ten foot experience”.Traditional user interaction with television can be called “lean back”,signifying users who are passive consumers of content. Adapting thepersonal computer user interface to the ten foot experience posesserious challenges in the visual interface design, and in the use ofinput devices for user interaction with the iTV. The present inventionsaddress both of these challenges.

In the ten foot experience, normal Web fonts and graphics are typicallytoo small to be comfortably viewed. In addition, whereas computerscreens usually have a cursor to visually indicate the user's locationon the screen, on TVs other than HDTVs cursors were difficult to locate.A possible solution for ITV systems is to trans-code Web page content ona specialized server for more appropriate display on a televisionscreen, or on a client receiver or combination server-client process.For example, trans-codings may include larger-size font substitutions,and substitution for larger sized graphics with more apparent details.However, most companies are not prepared to spend the time or money togo through this effort.

One of the challenges in designing interactive television for the tenfoot experience has been planning user input to the iTV. It is difficultto interact with traditional web pages using input devices typicallyassociated with television. Navigation and typing are particularlydifficult with infrared remote controls or a virtual keyboard ratherthan a mouse and real keyboard. The use of a remote control limits thetraditional navigational model to a single dimension at a time (top-downor left-right). In addition, it is difficult for a user to selecthyperlinks using infrared remotes. As a result, the user would sequenceamong links e.g. using arrow keys, and then press a “Go”, OK or “Enter”key on the remote to switch a display to the linked page. Alphanumericinput has also been cumbersome using TV remotes, typically requiringentry of characters one-by-one using an alphanumeric menu. In summary,the use of a handheld TV remote for iTV navigation is awkward incomparison to a computer mouse and real keyboard located in fixedpositions on a desk or table, which provide fast homing times andefficient alphanumeric input. However, for the ten foot experience theobjective is to provide user input using a handheld device, not a devicelocated on a desk or table.

A type of handheld input device that affords additional degrees ofcontrol is an inertial pointing device, such as a 3D pointing device.Inertial pointing devices use a tuning fork or other accelerometer todetect movement for every axis supported by the device. 3D pointingdevices can determine device orientation as well as direction ofmovement in three (or more) dimensions. When used in connection with atelevision or computer display, 3D pointing devices move in the air infront of a display screen, and the user interface translates thosemotions directly into user interface commands, e.g., movement of acursor on the display screen.

One of the most popular applications of iTV is distribution of video andaudio content. Whereas traditional television relies on broadcast(content push) programming model, iTV relies on a library (content pull)programming model. iTV programming addresses viewers' desire to havecontrol over their viewing experiences, for example to watch what theywant when they want, and to be able to time-shift through media. The iTVuser interface also can cater to an extended range of user interests,including not only the traditional TV function of entertainment but alsofor example shopping (ecommerce), widgets, social networking andeducation. A well-designed iTV user interface should facilitate usercontrol over entertainment programming as well as access to content inother areas of interest, using a simple, logical and efficientframework.

SUMMARY OF THE INVENTION

Principal goals of the present invention include (a)Simplicity—employing a simple and consistent organization of elements tofacilitate visual perception, together with a straightforward sequenceof operations in navigating the user interface; and (b) DistanceViewing—providing a user interface that is compatible with viewing at adistance, the “ten foot experience”

The present interactive television user interface applies the followingdesign principles:

-   -   Reduces the number of key presses and mouse clicks needed to        achieve the desired result (identify and play media, etc);    -   Uses a primary screen with a simple clear layout, with a        visually consistent arrangement of on-screen navigation        elements;    -   Uses prominent on-screen selectors consistent with distance        viewing;    -   Prefers meaningful graphical symbols and images to abstract        icons; and    -   Uses three dimensional effects, employing the axis extending        into and out of the screen, that enhance the ten foot        experience.

The interactive television user interface of the invention incorporatesa novel graphical user interface (GUI) and a handheld user input device.The iTV GUI comprises a screen layout with a plurality of hot zoneslocated at the corners of the iTV screen, preferably all four corners Ahot zone is an area of active pixels of the iTV display that responds toa click action associated with a mouse cursor (a tracking spot thatindicates the current position of a pointing device). A second principalcomponent of the screen layout is a central menus screen. The centralmenu screen displays two-dimensional and three dimensional graphicalobjects that serve as prominent on-screen selectors suitable fordistance viewing of the iTV. Optional elements of the basic screenlayout include slider bars at the left and right screen edges forincrease-decrease control of iTV functions, such as television channeland audio volume.

The invention also comprises an efficient GUI navigation method for aninteractive television. In a preferred embodiment of the GUI navigationmethod, the user employs three click events to provide desired iTVoutput. In the basic navigational method, the user selects a functionfrom one of the corner hot zones—the first click event. The first clickevent causes display of on-screen selector objects in the central menuscreen. By selecting from the on-screen selector objects in the centralmenu screen the user displays a content screen—the second click event.The content screen enables the user to access desired content such asaudiovisual works, ecommerce web sites, social networking web sites,user created content, etc. In the third click event, the user displays,plays, orders, or otherwise obtains desired content using the contentscreen.

In the interactive television user interface of the invention the vieweruses a handheld input apparatus to effect “click actions”. Auser-effected click action causes a “click event” i.e. an event-basedprogramming response of the iTV, such as displaying a menu screen at thecentral menu screen area, launching an application, or linking to a URL.Click actions of the handheld input apparatus are mapped to clickevents—for example given movements of the apparatus can be mapped togiven cursor motions, or to given movements or appearance changes of GUIobjects.

The handheld input apparatus makes use of two types of click actions. Inthe first type of click action, the handheld input apparatus includes apointing device or mouse with which a user moves a mouse cursor on theiTV display. A cursor-based click action is effected while the mousecursor is located over an active pixel area of the screen, and maycomprise a mouse over or mouse button click. The active pixel areasinclude the hot zones, as well as “hot spots” within the central menuscreen. The second type of click action utilizes a motion-sensitivedevice. The motion-sensitive device senses a translational or rotationalmovement of the device, providing input to the graphical user interfacebased upon the sensed movement.

One aspect of the iTV screen layout of the invention is the physicalarrangement of active pixel areas for interaction with the pointingdevice. The hot zones and the central menu area do not overlap, i.e.active pixel areas in the central menu screen (hot spots) cannotcoincide with one of the hot zones. The hot zones are permanently activepixel areas anchored to the screen corners, whereas the hot spots in thecentral menu area are pixel areas that are active only at certain statesof the navigation interface typically involving opening of anapplication or web page. GUI objects that interact with pointing devicesalso can include an “extended zone”, which corresponds to one of the hotzones and is anchored at the same screen corner as that hot zone but islarger than the hot zone. An extended zone may appear in response to apointing device click action (button click or mouse over) at one of thehot zones, and contains temporarily activated pixel areas typicallyarranged in a plurality of layers. Unlike the hot zones the extendedzones may overlap the central menu screen, and the extended zonesgenerally display more information (graphics and text) than the hotzones.

The hot zones may be considered as the first level of the navigationinterface; the central menu screen as the second level; and the contentscreen as the third level. In a basic “three-click” navigation method, asingle click action at a hot zone (first level) launches GUI objects inthe central menu screen—the first click event. A single click actionacting on a GUI object in the central menu screen (second level) causesthe display of a content—page the second click event. A single clickaction at the content page (third level) then provides the desiredcontent—the third click event.

The first click event at one of the hot zones or the second click eventat the central menu screen may also be effected through multiple clickactions. An initial click action changes the appearance of thenavigation interface to present additional information, and a subsequentclick action navigates to the next level. In a first multi-click actionexample, at the first level an initial pointing device click action at ahot zone displays an extended zone anchored at the same corner. Theextended zone typically appears as a two-dimensional or threedimensional layered pattern in which each layer is associated with amenu choice, generally represented by a graphical object or icon. Theuser selects a graphical object in one of the layers of the extendedzone, thereby launching a second-level navigation interface at thecentral menu area. The user may use additional click actions at theextended zones, such as paging through layers or turning over a layer toview additional information, before selecting a given layer (menuchoice). In a second multi-click action example, at the second level theuser turns over a GUI object in the central menu screen via an initialclick action to view information on the other side of the GUI object,then selects the GUI object via a second click action to open a contentpage.

A preferred user interface layout for interactive televisions includeshot zones at the four corners of the display screen and slider bars atthe left and right screen edges, all being control elements for userinputs. The hot zones are typically used for multiple-choice inputs,while the slider bars are used for digital quantitative inputs. The hotzones have associated functions with data sets that can change dependingon context. Likewise the slider bars have associated functions with dataranges that can change depending on context. Context changes include forexample selection of a multiple choice at one of the hot zones; a changeof content displayed at the central display area; selection of a controlelement in the central display area; concurrent changes of hot zone andslider bar functions; and prescribed click actions of the handheld inputdevice, such as an “exit” input to move back to a prior navigationconfiguration.

A further aspect of the invention is a “horizon line” graphical userinterface control for increase and decrease of a function. In a basicembodiment, the horizon line control comprises a horizon line extendinghorizontally or vertically across the iTV screen, wherein the locationof a user-moveable object (cursor) on one side of the horizon linecauses an increase of a controlled function, and cursor location on theother side of the horizon line causes a decrease of the same function.The rate of increase or decrease may accelerate with distance from thehorizon line, for example as a linear or (preferentially) logarithmicfunction of distance. The horizon line may be invisible, visible, or maybecome visible upon some event such as crossing the horizon line. A rateindicator may depict the rate of increase or decrease. The horizon linecontrol can be interposed over or juxtaposed with another image e.g. asa transparent overlay.

In a more advanced version of the horizon line user interface,horizontal and vertical horizon line controls are used in combination,thereby providing simultaneous increase-decrease control of twodifferent functions. This two-dimensional horizon line control can helpthe user visualize a coordinated increase or decrease of the level ofthe controlled functions.

In a further variation, a Z-axis horizon line control is used with thex- and y-axis controls to provide three degrees of control (3D horizonline interface). In one embodiment, the 3D horizon line interfaceincludes a threshold plane and an active plane. The active plane maycomprise a user-movable object that can move from a location in front ofthe threshold plane, to a location behind the threshold plane (or viceversa), in order to change between increase and decrease of a Z-axiscontrolled function. Depth cues such as linear perspective and size mayimprove visualization of the Z-axis dimension of control.

In a flexible navigation method according to the invention, the user isgiven a choice of two or more click actions of the handheld inputapparatus with which to effect a given click event. For example, theuser may have a choice of either a cursor-based click action or amovement-based click action to effect the same click event. Thisaccommodates users who prefer to use pointing devices, and users whoprefer to use motion-sensitive devices. The navigation interfaceincludes a visual cue to both click actions. For example acircular-arrow icon can be coextensive with hot spots that cause a mouseover of the pointing device to effect a given click event; thiscircular-arrow icon also can prompt the user to make an angular-rotationmovement of the motion-sensitive device to effect the same click event.

Another aspect of the invention relates to the use of three dimensionalgraphical objects and visual settings to facilitate distance viewing ofthe iTV GUI. The extended zones may display visible three dimensionalshapes or textures to facilitate user discrimination of hot zonefunctions and menu choices. As used herein, “three dimensional”graphical display objects (or shapes or textures) are objects (or shapesor textures) that appear to have an extension in depth. For example,corner steps or other visibly layered structure may identify amulti-layer overlay structure. The central menu area also may displayobjects with an apparent three dimensional shape or texture, such aspolyhedrons or other multi-surfaced objects, and may use object motionand/or apparent change of perspective within a three dimensional spaceto display different surfaces of the objects. In addition, the centralmenu area may animate two dimensional forms within three dimensionalspace, such as by scaling up or scaling down an object to simulate“Z-axis” movement toward or away from the viewer (“zoom” function); byturning a tile, page, or three dimensional object to view a differentsurface (“turn” function); or by flipping through a stack of tiles orpages (“leaf” function). Interactive television can utilize variousvisual depth cues such as texture gradient, size, interposition, andlinear perspective, which can be based upon aspects of the natural 3Denvironment that help people to perceive depth. In the iTV navigationinterface, such depth cues can act as visual cues that suggest certainclick actions or click events.

One three dimensional visual effect combines scaling up objects (zoomin) with an appearance state change comprising a distinctive increase oflevel of detail. This appearance state change of level of detail isassociated with a state change of control function. For example duringthe state change of appearance, a single unfocused object may resolveinto multiple graphical features, each representing a differentselection choice.

A further aspect of the invention relates to a method of adapting a webpage designed for personal computer interfaces (one foot experience) toa web page that is suitable for distance viewing of interactivetelevision (ten foot experience). Such a web page can serve as thecentral menu screen in the three-click navigation method. Basic stepsfor adapting a traditional web page to serve as a content page in thethree-click navigation method include:

-   -   Identify and extract the essential features of the web page;    -   Disaggregate these features into data objects, preferably using        metadata;    -   Reformat the data objects (such as tiles, lists, etc) as        graphical objects having a form and layout suitable for distance        viewing, based upon the design techniques of the invention; and    -   Revise and reposition text and graphics within the data objects        suitably for distance viewing.

Preferably the reformatting of data objects utilizes three dimensionaldata objects and/or animated data objects. Preferably also the revisionand repositioning of text and graphics includes reformatting text and/ordetailed graphics in magnified form and/or on multiple surfaces of athree dimensional graphical object. These design rules provide a moreuniform look and feel for the navigation interface, whether embodied inan original design, or a web site redesign.

According to an aspect of the invention, a method of selecting contentto be displayed on an interactive television includes: displaying alayout the interactive television, wherein the layout includes at leasttwo hot zones in respective corners of the layout; when a user selects aselected hot zone from one of the hot zones using an input device,triggering display of an extended zone corresponding to the selected hotzone, wherein the extended zone is in the corner of the selected hotzone and is larger than the selected hot zone; and when the user makes aselection from the extended zone, displaying in an area of the layoutthat is not anchored to the hot zone, a menu corresponding to theselection from the extended selection space.

According to another aspect of the invention, a method of controlling aninteractive television, the method including: displaying a layout on theinteractive television, wherein the layout includes one or more visualcues to prompt a user regarding an action (click action) to be taken onan input device to activate a predetermined function (click event).

According to yet another aspect of the invention, a method of display onan interactive television, the method including: receiving informationregarding a web page; extracting text and data objects of selectedfeatures of the web page; reformatting the data objects of the selectedfeatures of the web page for distance viewing; and arranging thereformatted data objects and other parts of the selected features fordisplay on the interactive television.

According to still another aspect of the invention, a method ofcontrolling a television, the method including: providing a line and auser-movable object (cursor) on a layout displayed on the television;and increasing a control function when the user-movable object is on oneside of the line, and decreasing the control function when theuser-movable object is on the other side of the line.

To the accomplishment of the foregoing and related ends, the inventioncomprises the features hereinafter fully described and particularlypointed out in the claims. The following description and the annexeddrawings set forth in detail certain illustrative embodiments of theinvention. These embodiments are indicative, however, of but a few ofthe various ways in which the principles of the invention may beemployed. Other objects, advantages and novel features of the inventionwill become apparent from the following detailed description of theinvention when considered in conjunction with the drawings.

It will be appreciated that this application contains a variety ofinventive aspects of many different types. References herein to “theinvention” or otherwise to inventive aspects should not be considered aslimiting in any way. For example such a reference should not beinterpreted as requiring a feature or features as being necessary.Rather the claims stand on their own, whether or not they recite any orall of the features described below as associated with “the invention.”

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a plan view of the basic design layout of an iTV navigationinterface.

FIG. 2 a further view of the basic design layout, showing thethree-click navigation method.

FIG. 3A is a view of the basic design layout, showing a multi-layerextended zone at one of the hot zones.

FIG. 3B is a view of the basic design layout, showing the extended zoneof FIG. 3 with an alternative active layer.

FIG. 4 shows IP TV menu functions displayed in matrix view in thecentral menu screen.

FIG. 5 shows Internet Services menu functions displayed in matrix viewin the central menu screen.

FIG. 6 shows Movies sub-functions of IP TV displayed in matrix view inthe central menu screen.

FIG. 7 shows User Content menu functions displayed in matrix view in thecentral menu screen.

FIG. 8 shows Setup menu functions displayed in matrix view in thecentral menu screen.

FIG. 9 shows a display screen of IP TV search results, in stacked view.

FIG. 10 shows a display screen for IP TV search results, in matrix view.

FIG. 11 shows a display screen for Movies search results, in list view.

FIG. 12A shows a circular-arrow icon 150 for performing a turn function.

FIG. 12B shows a tapered arrow icon prompting a zoom function.

FIG. 12C shows a “winding road” arrow icon prompting a leaf function.

FIG. 13A is an upper perspective view of a handheld input apparatus.

FIG. 13B is a lower perspective view of a handheld input apparatus.

FIG. 14 is a schematic diagram of an alternative handheld inputapparatus, showing the six degrees of freedom of the input apparatus inrelation to the three dimensions of the iTV's visual user interface.

FIG. 15 shows IP TV menu functions displayed in a three-dimensionalmatrix view in the central menu screen, illustrating the zoom functionand a turn-function navigational icon.

FIG. 16 is a schematic diagram of the software stack for an interactivetelevision using the invention.

FIG. 17 shows the elements of a personal computer (one foot experience)web page.

FIG. 18 shows a converted version (ten foot experience) of the web pageof FIG. 17 using the design principles of the invention.

FIG. 19 is an alternative basic layout of an iTV navigation interface.

FIG. 20 shows the iTV layout of FIG. 19 adapted to an IP TV context.

FIG. 21 shows the iTV layout of FIG. 19 adapted to a Concierge context.

FIG. 22 is a simulated 3D view of a cuboid displaying Concierge content.

FIG. 23 is a simulated 3D view of a stack of panels displaying Conciergecontent.

FIG. 24 illustrates an exemplary iTV graphical user interface withhorizon line control layout.

FIG. 25 illustrates an alternative iTV graphical user interface withhorizon line control layout.

FIG. 26 illustrates a further iTV graphical user interface with verticalhorizon line control layout.

FIG. 27 illustrates a further iTV graphical user interface with two-axishorizon line control layout.

FIG. 28 illustrates an iTV graphical user interface with asymmetrichorizon line control layout.

FIG. 29 illustrates an iTV graphical user interface that incorporatesdepth cues, with an active plane closer to the viewer than a referenceplane.

FIG. 30 illustrates an iTV graphical user interface that incorporatesdepth cues, with the active plane farther from the viewer than thereference plane.

DETAILED DESCRIPTION

A method of selecting content for display on an interactive televisionmay involve a multilevel selection process that includes selectable hotzones, for example in corners of a graphical user interface, and acentral menu area. Selection of a hot zone may cause an increase in sizeor extension of the zone, prompting a further selection. This may leadto a display of content items in a central menu, with the user selectingcontent for display from the central menu.

A method of controlling an interactive television includes displaying alayout on the interactive television that includes one or more visualcues to prompt a user regarding an action (click action) to be taken onan input device to activate a predetermined function (click event). Thevisual cues may include multiple visual cues, at least one of which is avisual cue for a cursor-based action that includes positioning a cursorwith an input device, and another is a visual cue for a movement-basedaction that includes moving the input device.

A method of display on an interactive television includes receivinginformation regarding a web page, extracting text and data objects ofselected features of the web page, reformatting the data objects of theselected features of the web page for distance viewing, and arrangingthe reformatted data objects and other parts of the selected featuresfor display on the interactive television. The method may result in areconfiguration of a web page from one more appropriate for display on acomputer to one more appropriate for display on an interactivetelevision.

A method of controlling a television increasing a control function whena user-movable object is on one side of a line displayed on a layout,and decreasing the control function when the user-movable object is onthe other side of the line. The method may involve movements in one,two, or three dimensions.

FIG. 1 shows a basic screen layout 10 of a graphical user interface forinteractive television (iTV). The iTV GUI comprises a screen layout 10with a series of hot zones 12 located at various corners of the iTVscreen, preferably all four corners. A hot zone 12 is an area of activepixels of the iTV display that responds to a mouse cursor associatedwith a pointing device. A second principal component of the screenlayout is a central menu screen 14. The central menu screen 14 displaystwo-dimensional and three dimensional graphical user interface objects(not shown in this view) that serve as prominent on-screen selectorssuitable for distance viewing of the iTV.

The navigation method of the invention uses an efficient sequence ofuser actions based upon the screen layout 10 of the invention, as shownin FIG. 2. The user interface of the invention employs a logicalstructure that avoids the need for excessive user actions; in many casesthe user can use three click actions to reach desired content. In thepreferred navigational method of the invention, the user selects afunction from one of the corner hot zones 12 (level {circle around (4)}of the navigation interface). This is the first click event. The firstclick event causes the display of a menu or other GUI objects in thecenter menu screen 14 (level {circle around (2)}). Selecting from anon-screen selector in the menu screen displays or links to a contentpage 20—the second click event. For viewing convenience in FIG. 2 thecontent page 20 (level {circle around (3)}) is shown below rather thanoverlaid over the main screen 14. The content page 20 enables the userto access desired content such as audiovisual works, ecommerce websites, social networking web sites, user created content, etc. Thecontent page 20 may for example be a structured markup page such as aweb page and may be accessed by in-line linking to a URL, by an RSSfeed, by loading a PC application, by opening a local file, etc. In thethird click event, the user displays, plays, orders, or otherwiseobtains desired content from the content page 20.

Click Actions and Click Events using Handheld Input Apparatus

In the interactive television user interface of the invention the vieweruses a handheld input apparatus to effect a “click action”. Auser-effected click action causes a “click event”, which is anevent-based programming response of the iTV such as displaying a locallystored menu screen at the central menu screen area, launching anapplication, or linking to a web site. The handheld input apparatusmakes use of two types of click action. In the first type of clickaction, the handheld input apparatus includes a pointing device or mousewith which a user moves a mouse cursor on the iTV display. Acursor-based click action is effected while the mouse cursor coincideswith one of the edge-area hot zones, or when the mouse cursor coincideswith a hot spot within the central menu area. A second type of clickaction utilizes a motion-sensitive device. The motion-sensitive devicesenses a user motion, i.e. translation or rotation, providing input tothe graphical user interface based upon the sensed motion.

Examples of the first type of click action include depressing the buttonof a pointing device while the cursor is located within one of the hotzone or hot spots, and a “mouse-over” in which the user moves or hovers(holds for a predetermined length of time) the cursor over one of thehot zones or hot spots. In the second class of click action, the motionsensor can be programmed to associate given translational or rotationalmovement of a motion-sensitive device with pre-assigned user interfaceevents. Examples of the second type of click action include a givenangular rotation of the motion-sensitive device, a vertical “hammer”movement, and forward and reverse translational movements.

In the preferred embodiment, the pointing device and motion-sensitivedevice are combined in a single hand held input apparatus, such as awand that is moved by the user in air as contrasted to the user'smovement of a computer mouse on a desktop or other flat surface. FIGS.12 and 13 illustrate a preferred hand held input apparatus combining thefunctions of pointing device and motion-sensitive device, as discussedin more detail below.

Hot Zones

In the basic navigation method, the hot zones 12 act as a first level ofthe iTV graphical user interface. By moving the mouse cursor into one ofthe hot zones with a button-click or mouse over click action, the userselects a category associated with one of the corner hot zones—level{circle around (1)}. This click action launches GUI objectscorresponding to that category at the central menu area 14—level {circlearound (2)} (FIG. 2). The “hot zones” and the central menu area do notoverlap, i.e. an active pixel area (“hot spots”) in the central menuscreen cannot coincide with one of the hot zones. The hot zones 12 arepermanently active pixel areas at the screen corners, whereas the hotspots in the central menu area are pixel areas that are active only atcertain states of the navigation interface. Typically the hot spots 12are activated upon opening an application or web page at the centralmenu screen.

The hot zones 12 may be invisible areas of active pixels at the screencorners that may display visible content upon a mouse click or mouseover. Alternatively, the hot zones 12 may comprise visible twodimensional or three dimensional colors, textures, or patterns. Thesevisual attributes can help users identify given menus without having toread hot zone text, and can alert users to a change of hot zone dataassignments in cases in which the hot zones content varies depending oncontext. The hot zones 12 are generally limited in size, as they do notconvey extensive information to the user but merely serve as launchingzones anchored at the screen corners. The hot zones 12 may take avariety of shapes, preferably regular shapes that include the edgesadjacent the respective screen corners. In the embodiment of FIG. 1, thehot zones 12 are quarter-circles that are color-coded to associatedcategories IP TV, Internet Services, User Content, andUtilities/Settings.

The GUI objects of the preferred navigation layout also include an“extended zone”, a GUI object that includes one or more active pixelarea, wherein the extended zone like the corresponding hot zone isanchored at one of the screen corners. FIGS. 3A and 3B show examples ofextended zones 24. An extended zone 24 may appear in response to apointing device click action (button click or mouse over) at one of thehot zones, and contains a series of activated pixel areas typicallyarranged in layers. Unlike the permanently active pixels of the hotzones 12, the activated pixel areas of the extended zones 24 aretemporary and may overlap the central menu screen 14. The extended zones24 are generally larger and display more information (graphics and text)than the hot zones 12.

The extended zone 24 of FIGS. 3A and 3B includes five layerscorresponding to Users, TV Setting, Network Settings, Security, and FileManagement functions. The extended zone 24 appears as a rectangularstack of layers each including a tab 26 projecting from the stack. Eachtab 26 includes an icon identifying the associated function, except forthe tab 26 of the uppermost (active) layer which includes a “windingroad” navigation icon 30 (this icon is discussed below at “AlternativeClick Actions Prompted by Visual Cue”). The active layer 32 displays itsicon in enlarged form, with the name of the function. Thus in FIG. 3A,the TV Setting layer is active, i.e. a mouse click or mouse over withinthe enlarged icon selects the TV Setting function thereby opening GUIobjects relating to TV Setting in the central menu screen. In FIG. 3B,the security function is active.

In the extended zone of FIGS. 3A and 3B, the user can switch activelayers 32 in the extended zones 24 by pointing at the tab 26 of thedesired layer. Alternatively, the user can point at the “winding road”navigation icon 30 at the tab 26 of the active layer 32, causing thegraphical user interface to flip through the layers (the “leaf”function, discussed below). When a desired function is active, the usercan select that layer. A forward-backward-forward horizontal motion ofthe motion-sensitive handheld apparatus will cause this same click eventof flipping through the extended zone layers.

The extended zones 24 differ from known GUI tools such as task bars andcascading menus in their use of graphical images that are designed fordistance viewing. Unlike task bars and cascading menus, the preferredextended zones 24 comprise layered structures that extend beyond the hotzones 12 but still retain the hot zones' character of corner GUIfeatures. The extended zone 24 can use various visual attributes todistinguish layers, such as color coding and icons (as in FIGS. 3A and3B), shape and texture. Each icon is associated with its menu option.Preferably the extended zone 24 uses a visual format that is visuallyassociated with the screen corner, for example, a 3D simulation of alayered structure extending from the screen corner.

An extended zone 24 is launched by activating a hot zone 12 and isanchored in the corner that anchors that hot zone 12. As shown in FIGS.3A and 3B, the extended zones 24 may overlap the central menu area 14and may have active pixels in this area. However when GUI objects arelaunched in the central menu screen 14 (transition to level 2), theextended zones 24 become inactive.

In addition to their primary function as a launching point—the firstlevel of the iTV's navigation interface—the hot zones 12 may be used atthe second and third levels of the navigation interface. In this case,the hot zones' data assignments, and data sets of any associatedextended zones, may change depending on the state of the navigationinterface in the central menu area. The navigation interface may providea visual indication when the hot zone data assignments change.

Preferably as seen in FIGS. 1 and 2, the navigation layout also includesslider bars 40 at the screen edges, GUI controls that are used fordigital quantitative inputs such as for volume selection for audiocontent and channel selection for television programs. The slider bars40 are discussed below.

Central Menu Screen—Three Dimensional Graphical User Interface forInteractive Television

FIGS. 4-8 show various hot zone menu items opened as tiles in thecentral menu screen 14. FIG. 4 shows an IP TV Menu 50, which includesselectable items (such as GUI objects or elements) for Movies, TV, UserContent, Top Downloads, What's New, and Recommended. FIG. 5 shows anInternet Services menu 52, which includes selectable items (such as GUIobjects or elements) for Social, Widgets, Internet Radio, Favorite WebSites, Shopping, and Interactive. FIG. 6 shows a Movies Menu 54, whichincludes selectable items (such as GUI objects or elements) for Newest,Top Movies, Genres, Try This, Trailers, and Alphabetical Search. FIG. 7shows a User Content Menu 56, which includes selectable items (such asGUI objects or elements) for Favorites, Photos, Videos, Audio, Blogs,and Albums. FIG. 8 shows a Setup Menu 58, which includes selectableitems (such as GUI objects or elements) for Network, TV Setting, Skin,Notifications, Parental Control, and Security.

Advantageously, the GUI objects in the central menu screen may becoordinated visually and logically to facilitate user navigation betweenlevels of the navigation interface. The menu items of FIGS. 4, 5, 7, and8 are matched to the hot zone categories of FIG. 1. These menu screensmay be coordinated visually with the respective hot zones using colorcoding of the hot zone categories. All GUI elements of FIGS. 5, 7 and 8may be color coded to match the corresponding hot zone category, whileFIG. 1 shows an example of mixing hot zone categories at the menu screen(in this case, including User Content items in the IP TV menu screen topermit users to play personal content). Other graphical techniques canbe used to coordinate between the first and second levels of thenavigation interface such as shapes, textures and icons. In thenavigational hierarchy shown in FIGS. 1, 4-8, the menu screens of FIGS.4, 5, 7 and 8 are at the same level of the hierarchy as the hot zonecategories of FIG. 1, while the Movies Menu 54 of FIG. 6 is a sub-levelunder the IP TV category.

The central menu screen 14 can use a variety of layouts with twodimensional and three dimensional graphical user interface objects.Traditional two-dimensional layouts include tiles arranged in a matrix,stack, or list. FIG. 9 shows a layout of two-dimensional tiles 70 in astacked view 72. FIG. 10 shows a layout of two-dimensional tiles 74 in amatrix view 76. FIG. 11 shows a layout of two dimensional tiles 78 in alist view 80. Although these views are largely two-dimensional innature, they can be combined with three dimension effects throughanimation creating apparent motion of the tiles in space, as discussedbelow. FIGS. 9-11 also illustrate GUI control elements including a backbutton 84; view type selectors (matrix, stack, list) 86; a resize menu88; a close menu 90; a next menu set 92; and a previous menus set 94.This central menu screen layout 14 (of any of the various types) mayalso include an alphabetical search element 96.

A commonly used hot zone menu is IP TV, the selection of which enablesthe users to select streamed and broadcast television programs, movies,and other video content. In a preferred version of the three-click userinterface for interactive television, the traditional televisionfunction of entertainment is expanded to also include other uses such asshopping (concierge function), social networking, widgets (e.g. clock,calendar; finance), and user content. In addition the iTV permitsconvenient user adjustment of settings and device inputs (e.g. TV, HDMI,VGA, USB, etc). The hot zone categories may be customized by the systemdesigner to provide different menu screens for these iTV functions.

In a preferred embodiment, the navigation interface spatial design isthree-dimensional. By this it is meant that the navigational interfacespatial design gives the illusion or feel of navigating in athree-dimensional space, although of course it will be appreciated thatonly two dimensions are displayed on the screen. The navigationinterface can use three-dimensional icons and other 3D imagery forricher user interaction. The use of three -dimensional imageryfacilitates user viewing in the ten-foot experience. For example, usersmay navigate through three-dimensional space from multiple points ofview, such as multi-surfaced icons that display information on differentsurfaces. In addition, the navigation interface can animate twodimensional graphical objects in three dimensional space. Users canthereby manipulate the objects in various ways to display graphicalfeatures or textual information. Examples of these manipulationsinclude:

-   -   “turn”—turning a tile, page or other object to view information        on another surface, such as the opposite side of one of the        tiles in the matrix view 76 of FIG. 10;    -   “leaf”—paging through a stack of objects or a multi-layered        object, such as the tiles in the stack view 72 of FIG. 9, or the        extended zone layers of FIGS. 3A and 3B;    -   “zoom”—changing the scale of objects e.g. scaling up an object        to view additional graphical detail or larger sized text, such        as the central tile 110 in the matrix view 112 of FIG. 15.

These animation functions also can be applied to three dimensionalgraphical objects. Applications of the turn, leaf and zoom functions tothree dimensional graphical objects are discussed below with referenceto FIGS. 22 and 23.

The invention uses visual metaphors that are well known and familiarfrom every day life to guide viewers through the navigation interface,helping to relate user actions to desired results. Visual metaphorexamples are described below at “Alternative Click Actions Prompted byVisual Cue” and at “Scale up of 3D objects with appearance state change(Level of Detail)”.

Visual cues also can be used in flat displays to provide users withperception of depth. In a natural 3D environment, people rely on manyaspects of the environment that help them to perceive depth. Adding asense of depth to a flat display involves simulating these visual cueson the display terminal. Herein such visual cues that provide users withperception of depth are called depth cues.

One category of depth cues is color or texture cues, which help peopleto perceive depth based on differences in object colors or texture. Wellknown examples include object shading, and texture gradient. A secondcategory of depth cue is size cues, in which the apparent size of theobject indicates its distance from the viewer. Well known types of thisdepth cue include relative size (based upon differences in image sizethat the object produces on the retina) and known size (in which theviewer takes into account previous knowledge of the actual size ofobjects).

A third category of depth cue is position cues, which give depthinformation based on where the object is located. One such depth cue isinterposition, in which one object is partially occluded by another, andit is assumed that the second is the closer object. Another case ofposition cues is linear perspective, a form of perspective in whichparallel lines are represented as converging so as to give the illusionof depth. A further type of position cue is stereopsis, which dependsupon a viewer's eyes being separated from each other, each eye receivinga different image of a scene. In stereopsis, a viewer perceives thesetwo retinal images as a single three dimensional image, and candetermine depth by comparing the retinal images and noting thedifferences.

In addition to the above categories of depth cues, which all deal withstationary objects, a fourth category of depth cue is motion parallax,which deals with object movement. Motion parallax refers to a change ofangular position of two observations of a single object relative to eachother as seen by a viewer, caused by the relative motion of the viewer.

Various imaging techniques develop illusionary effects which, broadlyspeaking, manipulate a monocular or two-dimensional image in such a waythat an illusion of three-dimensionality is perceived by the viewer. Twomajor factors that contribute to the perception of depth are parallax(resulting from the separation of the two eyes), and perspective(characterized by the representation of three-dimensional objects anddepth relationships on a two-dimensional surface). The impact ofparallax upon three-dimensional perception diminishes rapidly withdistance. Television watching at distances of ten feet and higher can beconsidered distance viewing, which is amenable to three dimensionalvisual effects. Objects that provide a strong impression of threedimensions can provide compelling visual cues in an interactivetelevision system.

FIG. 22 shows an example of a polyhedron 120, one of a group ofpolyhedra (three dimensional bodies bound by faces) with different GUIimages on different faces or surfaces of each polyhedron. The polyhedron120 of FIG. 22 is a cuboid, i.e. a parallelepiped in which each face isa rectangle. The group of cuboids could display views relating to theconcierge function as applied to cinema entertainment, which isdescribed in greater detail below, with (for example) the upper part ofcuboid displaying information about a particular theater, schedule,ticket prices, etc. and the lower part of the cuboid displaying stillsof movies playing at a chosen theater. The user can apply the GUI's turnfunction to rotate a cuboid, and the zoom function to scale up a surfaceof interest.

FIG. 23 shows another 3D image 130 based upon the concierge function,comprising a stack of panels 132 displaying movie stills on exposedpanel faces. The panels 132 on the left side are tilted to the left, todisplay images on their right-hand faces, while the panels on the rightside are tilted to the right, to displace images on their left-handfaces. A central area between the two stacks of panels displays anadditional image facing 134 the viewer. The exposed left panel, centralarea, and exposed right panel collectively form an interior displayspace similar to interior walls of a box, in contrast to the exteriorsurfaces of FIG. 22. A viewer can leaf through the stacked panels 132 toexpose new surfaces; select a panel 132 to move it out of the stacktoward the viewer (zoom function); and turn over the enlarged panel 134thereby displaying additional information.

Navigation Interface Feature: Alternative Click Actions Prompted byVisual Cue

In a flexible navigation method according to the invention, the user isgiven a choice of two or more click actions of the handheld inputapparatus with which to effect a given click event. For example, theuser may have a choice of either a cursor-based click action or amovement-based click action to cause the same click event. Thisaccommodates users who prefer to use pointing devices, and users whoprefer to use motion-sensitive devices. The navigation interfaceincludes a visual cue to both click actions.

This visual cue plays a dual role that is compatible with both clickactions. For example, a navigation icon can be coextensive with hotspots in the central menus screen to actuate cursor-based click events,and can be associated with pointing device movements to promptmotion-based click events. Either type of click action—whichever iseasier for the viewer—will be successful.

Examples of these navigation icons include are shown in FIGS. 12A-12C.FIG. 12A shows a circular-arrow icon 150 for turning images, pages ortiles (turn function). FIG. 12B shows a tapered arrow icon 152 promptingupward translational movement of the motion-sensitive device, andsuggesting a scaling up effect (zoom function). FIG. 12C shows a“winding road” arrow icon 154 prompting forward-backward-forwardtranslational movement of the motion-sensitive device, e.g. to initiatethe leaf function.

FIG. 15 shows the circular arrow icon 150 displayed on a selected tile112 in a 3D matrix view 110, in which a selected tile 112 is shown atlarger scale than other tiles. Mouse-over at the circular arrow on theselected tile 112 will cause the tile to turn over (turn function). Inaddition, the tile will be turned over by one of the “turn” rotationalmovements of the motion-sensitive device such as rotate-twist(left-right-left) 5-10° (see Table 2 below).

A second example is shown in FIGS. 3A and 3B. The user can point at thewinding road icon 30 at the tab 26 of the active layer, causing thenavigation interface to flip slowly through the layers (“leaf”function). When a desired function is active, the user can select thatlayer. A forward-backward-forward horizontal motion of themotion-sensitive handheld device will cause this same click event offlipping through the extended zone layers (see Table 2). The windingroad icon 30 or 154 suggests this forward-backward-forward translationalmovement of the motion-sensitive device.

These visual cues can suggest or prompt the click actions (e.g. the“winding road” icon), can suggest the click event, or can suggest boththe click actions and the click event (e.g. the circular arrow icon andtapered arrow icon). Visual cues that suggest click actions arepreferred.

Other visual objects besides icons can be used as visual cues, such asdepth cues embodied in three-dimensional objects or images, as describedabove. Examples of such depth cues, relating to Level of Detailtransitions, are described below at “Navigation Interface Feature: Scaleup of 3D objects with appearance state change (Level of Detail)”. Depthcues relating to three-axis images including linear perspective aredescribed below at “Horizon Line User Interface Control”.

An example of a depth cue suggesting a click action is a 3D image withlinear perspective that prompts a viewer to use a Six Degrees of FreedomMotion-Sensitive Device to cause perceived motion into or out of theZ-Axis of the image (axis z₂ at FIG. 14, described at “Handheld PointingDevice and Six Degrees of Freedom Motion-Sensitive Device” below). Anexample of a depth cue suggesting a click event is an image providing anillusion of a z-axis pathway that suggests movement of a navigationobject into and/or out of the television. Another example of a depth duesuggesting a click event is an abrupt Level of Detail transition inobject size and texture, which alerts a viewer to a control functionthat becomes available following the transition.

Navigation Interface Feature: Scale up of 3D objects with appearancestate change (Level of Detail)

Level of detail involves decreasing the complexity of a 3D objectrepresentation as it moves away from the viewer, or converselyincreasing the complexity of a 3D object representation as it movestoward the viewer. Level of detail transitions also can be associatedwith other metrics, such as object importance or position. Level ofdetail (“LOD”) is typically associated with object geometry, but alsomay involve other characteristics affecting the complexity of graphicalrepresentations, such as shading.

One embodiment of the invention utilizes a three dimensional effect thatcombines scaling up of objects with an appearance state changecomprising an abrupt, distinctive increase of level of detail. Thisappearance state change of level of detail is associated with a statechange of control function. At the time of the LOD transition, thesystem may load a new set of logic functions to change click eventsassociated with the 3D object.

In computer graphics, it is considered highly desirable to provide asmooth transition between LOD levels, in order to improve the realism ofa graphic representation. Techniques such as alpha blending or morphingcan be used to reduce abrupt visual transitions sometimes called visual“popping”. However, this embodiment of the invention recognizes that anabrupt, distinctive transition in LOD can serve as a visual cue,alerting the viewer to a change in the navigation interface controlfunctions or click events.

As an example of this embodiment, during zoom-in the appearance state ofan icon can change from displaying a single indistinct object todisplaying several distinct graphical features, and the control statecan change to allow the users to select among choices corresponding tothose graphical features.

Techniques for rendering a higher level of detail include for exampletexture mapping and bump mapping (e.g. to generate beveled edges of anobject). By contrast, a lower level of detail object may be shaded onesolid color. A well known technique for providing multiple levels ofdetail in a zooming user interface, sometimes called Discrete Levels ofDetail (DLODs), employs a plurality of pre-computed images, each being arepresentation of the same visual content but at different resolutions.As zooming occurs, the system interpolates between the DLODs anddisplays a resulting image at a desired resolution.

The invention uses level of detail techniques adapted to distanceviewing, i.e. the ten foot experience. In zooming in to provide largerimages with a higher level of detail, the invention uses a DLOD for at azoom-in end point that displays additional objects or features, ortransformed object types, that convey information that is logicallydistinguishable from the starting point image. For example, a relativelyunfocused, unitary image at the starting DLOD is transformed intomultiple, visually distinctive objects at the end point DLOD therebyconveying additional information following the zoom operation. Asanother example, a graphical image e.g. logo at the starting DLOD istransformed into alphanumeric content at the end point DLOD followingthe zoom operation. Visual perception in 10-foot distance viewingpermits the design of a sequence of images that bridge the starting andending DLODs resulting in a distinctive image transformation withoutdiscomfiting the viewer.

Handheld Pointing Device and Six Degrees of Freedom Motion-SensitiveDevice

The invention preferably uses a handheld input apparatus that combinesthe functions of pointing device and motion-sensitive device, the latterproviding six degrees of freedom motion sensing. FIGS. 13A and 13B showperspective views of a handheld input apparatus 200 (“wand”) forinteractive television based upon motion sensing products supplied bySengital Ltd., Hong Kong. In the upper perspective view of FIG. 13A,item 201 is a power on-off switch for the iTV. Item 202 is an analogstick button, which may serve as an enter button to confirm functions.Item 203 is a left button, which opens an active area of the graphicaluser interface at which the mouse cursor is located, e.g. a hot zone, ora hot spot within the central menu area. Item 204 is an analog stick, atype of joystick that consists of a protrusion from the pointingdevice's controller providing an input based on the position of thisprotrusion. The analog stick 204 may be manipulated by a user in amanner similar to how a joystick is tilted, for example to move a cursoror other element. Item 205 is a right button, which moves back to theprior layer of the navigation GUI (exit). In the lower perspective viewof FIG. 13B, item 206 is a tricker button, which turns on and off themotion sensing feature. As discussed below, these button and analogstick functions are programmable.

The wand styling of the preferred handheld input apparatus 200 of FIGS.13A and 13B evokes a TV (or gaming) remote rather than a PC-tetheredmouse. However, the wand's functionality goes far beyond traditionaltelevision remotes to provide mouse-like maneuverability. The wand 200allows users to interact with the screen by pointing and moving inair—no table is required.

The wand's controller (not shown) detects X, Y and Z translation motionof the pointing device, and detects pitch, yaw and roll rotationalmotion (rotation in three dimensions about the wand's center of mass).It will be appreciated that detection of translation and rotation ofdevices is known, for example as used in NINTENDO WII game systems. Thismotion-sensor can be combined with an analog stick button 202 in thepointing device 200, in which the device 200 detects depression of thestick button 202, and detects user movement of the stick 204 (e.g. moveleft, move right and hold).

FIG. 14 shows the six degrees of freedom of the handheld input apparatusor wand 200 similar to the wand 200 of FIGS. 13A and 13B, definedrelative to an iTV or other display device 210. These six degrees offreedom include x-axis, y-axis and Z-axis translational motions, andpitch, yaw and roll rotations around these axes. The x, y, and z axes ofthe handheld input device 200 are vectors following the right hand rule,wherein the y axis is the forward-pointing vector of the input apparatusand the x-y plane is approximately horizontal. FIG. 14 also shows theaxes of the iTV's three-dimensional display user interface (UI). X₂ andy₂ respectively are the horizontal and vertical axes of the display usedin describing two-dimensional UI locations and motions, while z₂ is theaxis extending into the display screen used (in addition to x₂ and y₂)in describing three-dimensional UI effects. In programming the handheldinput apparatus 200, translational and rotational movements of thehandheld input apparatus 200 in the x, y, and z axes can be mapped toresulting display user interface movements in the x₂, y₂ and z₂ axes, asexemplified by various mappings shown in Table 2 below.

Tables 1 and 2 give example mappings of click actions of the handheldinput device to on-screen actions of the navigation GUI. Considerationsin planning these mappings include:

-   -   The same pointing action (Table 1), or movement (Table 2), of        the handheld input device may have different results (click        events) depending on context    -   Contexts include the level of the navigation interface ({circle        around (1)}, {circle around (2)}, or {circle around (3)}), the        nature of the object that is active on screen, and whether a        special navigation mode (such as 3D effects) is active    -   Where ever possible, the results of a click action should bear a        natural relationship to the action.

Table 1 shows an example of mapping movement of the hand held inputapparatus (analog stick—item 4, FIG. 11) to navigation interfaceactions. These analog stick movements could be used for example tobrowse search results in the stacked view of FIG. 9, matrix view of FIG.10, and list view of FIG. 11.

TABLE 1 ANALOG STICK MOVEMENTS/EFFECTS CLICK ACTION CLICK EVENT Analogstick move Move tiles or windows into the screen left (West) from theleft side in Matrix View Analog stick move Move tiles or windowscontinuously into left (West) and hold the screen from the left side inMatrix View Analog stick move Move tiles or windows into the screenright (East) from the right side in Matrix View Analog stick move Movetiles or windows continuously into right (East) and hold the screen fromthe right side in Matrix View Analog stick move Navigate to next objectabove in Matrix View front (South) Page forward one object in List Viewor Stacked View (“Leaf”) Analog stick move Navigate continuously forwardwithin objects in front (South) and hold Matrix View Page continuouslyforward through stack in List View or Stacked View (“Leaf”) Analog stickmove Navigate to next object below in Matrix View back (North) Page backone object in List View tacked View (“Leaf”) Analog stick move Navigatecontinuously forward within objects in back (North) and hold Matrix ViewPage continuously back through stack in List View or Stacked View(“Leaf”)

Table 2 shows an example of mapping translational and rotationalmovements of the hand held input apparatus 200 (FIGS. 13A and 13B) tonavigation interface actions. The listed results of these variousmovements are exemplary, and not intended as complete. As examples ofdifferent results depending on context, it will be seen that the samemovement may cause a change in slider bar setting, or a movement oftiles or other objects in the central menu screen, depending on whatfunction is active. Preferably the mode of operation of the hand heldinput apparatus changes automatically based upon the state of thenavigation user interface. Alternatively the mode of operation maychange based upon a user selection of input mode. An example of theformer is a difference in object motion depending on the way objects arearrayed in the central menu screen. An example of the latter is useractivation and inactivation of a 3D Input mode including the zoomfunction (see Rotate (right-left-right) 45°).

TABLE 2 MOTION-SENSING DEVICE MOVEMENTS/EFFECTS CLICK ACTION CLICK EVENTMove horizontally Decrease setting by one step on (left-right-left) aselected slider bar Move tiles or windows into the screen from the leftside Move horizontally Increase setting by one step on the(right-left-right) selected slider bar Move tiles or windows into thescreen from the right Move horizontally to Decrease setting on sliderbar continuously the left and stay Move tiles or windows continuouslyinto the screen from the left side Move horizontally to Increase settingon slider bar continuously the right and stay Move tiles or windowscontinuously into screen from the right side Move vertically Increasesetting by one step on the slider bar (up-down-up) (e.g. Channel orVolume) Channel-after video hot zone is activated Move verticallyDecrease setting by one step on the slider bar (down-up-down) (e.g.Channel or Volume) Channel-after video hot zone is activated Movevertically up Increase settings continuously on the slider and stay baruntil stopped (channel numbers when video is activated) (volume settingswhen audio is activated) Move vertically Decrease settings continuouslyon the slider down and stay bar until stopped (channel numbers whenvideo is activated) (volume settings when audio is activated) Movehorizontally Zoom in or scale up by one step (when (forward-backward- in“3D Input” mode) forward) Navigate forward continuously in matrix viewPage forward continuously in Stacked View or Extended Zone (“Leaf”) Movehorizontally Zoom out or scale down by one step (when (backward-forward)in “3D Input” mode) Navigate backward by one object in matrix view Pagebackward one object in Stacked View or Extended Zone (“Leaf”) Movehorizontally Transfer objects or files from preliminarily to the leftand stay selected hot zone to central menu screen Move horizontallyTransfer objects or files from preliminarily to the right and stayselected hot zone to central menu screen Rotate-twist Decrease sliderbar setting by single step (left-right-left) 5-10° 

Rotate-twist Decrease slider bar setting by multiple steps(left-right-left) 45° 

Rotate (right-left-right) Turn over images or pages or tiles (“Turn”)5-10° Rotate (right-left-right) Toggle 3D Input Mode (on/off) 45° UpwardMotion Scale up selected object to double magnification (“Zoom”) HammerFunction Play Object

The click action-click event mappings shown in Tables 1 and 2 are merelyillustrative of the principles of the present invention. The effects ofthese analog stick movements and six degree-of-freedom movements, aswell as the button pushes, are freely programmable in the device 200 ofFIGS. 13A and 13B.

Interactive Television User Interface with Hot Zones and Slider Bars

FIG. 19 shows an alternative basic layout 300 for a user interface of ininteractive television.

This layout includes hot zones 312 at the four corners of the displayscreen, and slider bars 320 at the screen edges, all being controlelements for user inputs. The hot zones 312 are typically used formultiple-choice inputs, while the slider bars 320 are used forquantitative inputs within a range of digital values.

The corner hot zones 312 may be permanently active, i.e. responsive atall times to a pointing device. The hot zones 312 may operate inconjunction with extended zones, as described above with regard to FIGS.3A and 3B.

The slider bars 320 comprise a series of input elements corresponding toactive pixel zones, with associated values or levels of the controllediTV function. These values or levels may vary linearly with the positionof each input element 322 on the slider bars 320, or that may vary insome other way such as logarithmic function of element position. In theslider bars 320 of FIGS. 19-21 the input elements 322 appear as discretephysical components on the slider bar 320, but this discrete appearanceis optional.

Optionally, the navigation interface layout 300 may include a centraldisplay area that may display additional control elements and othervisual content, as shown in FIG. 21.

The hot zones 312 have associated data sets (i.e. controlled iTVfunctions) that change depending on context. Likewise the slider bars320 control associated functions with ranges of quantitative values, andthese controlled iTV functions change depending on context. In typicaloperation of this iTV user interface 300, the functions that areassigned to the four hot zones 312 may change simultaneously with achange of context. Similarly, the functions that are assigned to the twoslider bars 320 preferably change simultaneously with a change ofcontext. The function assignments for the hot zones 312 may or may notchange simultaneously with the function assignments for the slider bars320. Context changes include for example: selection of a multiple choiceat one of the hot zones 312 (e.g. selection of IP TV at the main hotzones configuration changes hot zones to the IP TV configuration); achange of content displayed at the central display area 324; selectionof a control element in the central display area 324; interdependentchanges of hot zone and slider bar assignments; and a prescribed clickaction of the handheld input device, such as an “exit” input to moveback to a prior navigation configuration.

The hot zones 312 or slider bars 320 may have appearance attributes suchas color, texture and shape that assist the user in identifying thefunctions and data assignments of these GUI elements. These appearanceattributes also can alert the viewer to a change of data assignments forthe hot zones 312 or slider bars 320. One example of appearance featuresis color coding of hot zones shown in FIGS. 19-21—for example grey forgeneral menus, blue for audio-video, and green for internet services.Another example is the difference in shapes of the slider bars 320 ofFIGS. 19-21. The tapered left-hand slider bar 320 in FIGS. 19-21connotes a gradation from lowest to highest level, whereas theconstant-width right hand slider bar 320 (which is bulged at theselected level in FIGS. 20 and 21) does not have this same connotation.A third example is a highlighted appearance of the right hand slider barof FIG. 21, indicating that slider bar 320 is active and will beaffected by a click action of the handheld input apparatus 200 (FIGS.13A and 13B).

FIG. 20 shows the hot zones 312 and the slider bars 320 configured forIP TV. In this configuration, the left-hand slider bar 320 controlsaudio volume level, and the right-hand slider bar 320 controls channelselection.

FIG. 21 shows the hot zones 312 and the slider bars 320 configured for aconcierge function, which assists a user in identifying suitableentertainment. In this configuration, the left-hand slider bar 320selects the price range of the entertainment item, and the right handslider bar 320 identifies the date of the entertainment item (e.g. toinvestigate a future entertainment event). In the concierge screen ofFIG. 21, the user has launched a local map 330 in the central displayarea via the Entertainment Venues hot zone. This map shows 330 thelocation of entertainment items returned by a search launched from theEntertainment Categories hot zone 312.

Horizon Line User Interface Control

A further aspect of the interactive television navigation interface is auser interface control for increase and decrease of a function. In abasic embodiment shown in FIG. 24, the increase-decrease controlcomprises a display screen 340 with a horizon line 342 extending along ahorizontal axis. Movement of the cursor to on one side of the horizonline 342 (in this case preferably, above the line) causes an increase ofa controlled function, and cursor location on the other side of thehorizon line (i.e. below the line) causes a decrease of the samefunction. In the versions of FIGS. 25-27, the increase or decreaseaccelerates at greater distances from the horizon line (or lines). Therate of increase or decrease may change linearly as a function ofdistance above or below the horizon line. Preferably, however, the rateof increase or decrease changes as a logarithmic function of distancefrom the horizon line.

In FIG. 25, the horizon line 342 extends horizontally across the iTVscreen 340, and the controlled function increases or decreases dependingon cursor location above or below the horizon line 342. This isrepresented by different lengths of displayed elements 344 above andbelow the horizon line 342. It will be appreciated that display of theelements 344 is not required, although display of the elements 344 mayserve as a visual cue for the user regarding the increase/decreasedepending on cursor location relative to the horizon line 342. In otherwords, the elements 344 may be used as a rate indicator.

Alternatively as shown in FIG. 26, the horizon line 350 extendsvertically across the iTV screen 352, and the increase or decreasedepends on cursor location on the left or right side of the horizonline. Preferably the horizon line 350 is centered on the screen 352(i.e. substantially equal space on both sides of the horizon line).Alternatively the horizon line 350 may be asymmetrically located on thescreen 352, which can be useful if the horizon line control is openedwhen the value of the controlled function is near the low end or highend of its normal range. Thus in FIG. 28, the horizon line control hasbeen opened when the controlled function (volume level) is high, and thehorizon line 360 appears in the upper area of the screen 362. Thehorizon line may be visible 360 (as shown in the Figures) or invisible.The horizon line may become visible upon some event such as a clickevent at a hot zone or central menu screen.

In cases in which the rate of increase or decrease accelerates atgreater distances from the horizon line, the user interface may includea rate indicator. The rate indictor is a visual indictor of the rate ofincrease or decrease of the controlled function. FIGS. 25-27 showvarious layouts with rate indicators extending transversely to thehorizon line(s). These rate indicators suggest the higher rates ofincrease or decrease at greater distances from the line. Unlike theslider bar controls of FIGS. 19-21 which may be similar in appearance,these rate indicators are not control elements but rather the entirescreen (except perhaps for corner hot zones, if present) is active. Thusa cursor located as seen in FIG. 26 will have the same effect as anycursor placement along the vertical axis including that location.

The horizon line user interface may also show the instantaneous value orstate of the controlled function, and thus show the increase or decreaseof this value or state over time. One example is seen in FIG. 26, whichincludes a volume level indictor 366 at the upper right corner of thescreen. Where the controlled function is a video setting, the userinterface may depict the setting through a graphical or video image. Forexample in the two-axis horizon line control 370 of FIG. 27 (asdiscussed below) the two controlled functions are the video settings hueand saturation, and the color gamut 372 at the lower right of the screenshows changes of hue and saturation settings through the changinglocation of a cursor.

The horizon line control can be interposed over another image as asemi-transparent overlay. Alternatively an opaque horizon line controlcan be shown side-by-side with another image via an embedded image, e.g.picture-in-picture. Thus a user might view the effect of change of videosetting caused by cursor location in the horizon line user interface(“UI”), by viewing changes in a background image or video.

In a more advanced version shown in FIG. 27, two horizon line controlsare used in combination, providing simultaneous control of two differentfunctions. One function changes depending upon vertical distance fromthe horizontal horizon line 374, while another function changesdepending upon horizontal distance from the vertical horizon line 376.This facilitates multi-variable control, as discussed below.

The horizon line UI control can be used to control the increase ordecrease of various iTV functions such as channel, volume, and videosettings such as contrast, brightness, backlight, hue, and saturation.In a two horizon-line UI, the control layout can help the user visualizethe relationship between changes of the two controlled functions. Thusfor example in FIG. 27, the horizontal horizon line UI may control hueand the vertical horizon line UI may control saturation. The user canmove the cursor around the screen depending on how the user wishes toadjust these settings, and can view current settings in the color gamutat lower right. The horizon line control also is useful in adjustinginterdependent functions, i.e. functions for which an increased level ofone generally calls for a decreased (or increased) level of the other.For example in setting brightness and contrast, if a user increases onefunction usually she should decrease the other, thus suggesting a cursorplacement in the upper right quadrant or lower left quadrant.

A further variation of the horizon line control interface includes threeaxes of increase-decrease control (3D horizon line interface). Whereasin a one or two dimensional horizon line interface the increase-decreasecontrol is typically visualized with respect to a horizontal or verticalline (or both) within the display plane, in a 3D interface the thirddimension of control requires another technique (i.e. depth cue) tovisualize the depth dimension of increase-decrease control. One suchtechnique, shown in FIGS. 29 and 30, uses virtual X-Y planes parallelwith the display plane. Each virtual plane can representincrease-decrease levels of a Z-variable function.

FIGS. 29 and 30 illustrate 3D horizon line interface display screensincorporating linear perspective to depict the depth dimension ofhorizon line controls. Each view shows two virtual planes including anactive X-Y plane, and a threshold plane. In these linear perspectiveviews, the smaller plane is farther away from the viewer, and converginglines at the corners of the planes are perpendicular to the planes (i.e.parallel to the Z-axis). The threshold plane intersects the Z-axis at apoint at which the Z-axis variable function remains constant. The activeplane includes X and Y horizon lines and a rectangular border, andrepresents a planar area that is active for the purposes of X-Y horizonline control. Cursor (or other control object) movement within theactive planar area effects increase-decrease control of X and Y controlfunctions.

In FIG. 29, the display screen 400 shows the active X-Y plane 402 closerto the viewer than the threshold plane 404. Since the active plane 402occludes the threshold plane 404 the latter plane is shown in phantom.In FIG. 30, the display screen 410 shows the active X-Y plane 410farther away from the viewer than the threshold plane 412. Z-axislocations of the active plane closer than the threshold plane, such asseen in FIG. 29, correspond to increase (or conversely, decrease) of theZ-variable function. Z-axis locations of the active plane farther thanthe threshold plane , such as that of FIG. 30, correspond to decrease(or conversely, increase) of the Z-variable function. As in theone-dimensional and two-dimensional horizon line interfaces, Z-axislocations at higher distances from the threshold plane can cause higherrates of change of the Z-axis variable function. In FIGS. 29-30, thereare rate indicators (420, 420A) for the Z-axis function at the upperleft Z-axis linear perspective line.

In the 3D horizon line control, various types of graphical objects canserve as user-movable objects for the third (Z-axis) dimension ofincrease-decrease control. An active plane such as shown in FIGS. 29 and30 can itself serve as a user-movable object. In response to a clickaction, linear perspective views can create an illusion of the activeplane moving toward, away from, or through the threshold plane. Othergraphical objects within an active plane also can serve as user-movableobjects. For example, the zoom function can be applied to a 3D graphicalobject 430 within the active plane to cause to object to scale up andappear to move closer to the viewer along with the active plane (sizedepth cue). An example of this type of user-movable object is the spherein the lower right quadrant of the active planes in FIGS. 29 and 30.Besides visual perspective and size, other types of depth cues can beused as visual cues to facilitate 3D horizon line control, e.g. thecolor or texture of the active X-Y plane can change when the plane movesfrom a location in front of the threshold plane, to a location behindthe threshold plane.

In a 3D horizon line interface the iTV screen normally displays views ofX-Y axes planes, with the Z-axis projecting perpendicular to the planes.However, the 3D interface can rotate the perspective of the 2D screendisplay, e.g. to show Y-Z axes planes. This may be desirable for exampleif the user wishes to control the Z-axis function via in-plane horizonline control, or to visualize interactive rate changes of the Y-variableand Z-variable functions.

The 3D horizon line user interface is compatible with both a pointingdevice, and a motion sensitive device such as the handheld apparatus 200of FIGS. 13A-14. Cursor movements within the plane control the increaseor decrease of the X-variable and Y-variable functions. The handheldinput device 200 can cause the GUI to display a virtual plane at adifferent level along the Z-axis, affecting the z-variable function. Theposition of the cursor relative to the (0, 0, 0) coordinate, and achange of the perspective in 3D space that is simulated in the 2D screendisplay, can be derived from pitch/roll/yaw rotation and translationclick actions of the motion sensitive device. Programming of a motionsensitive device can adapt engineering simulator and gaming techniquesto navigation of a three dimension horizon line display. Movement of thehandheld input device can create a visual effect of “flying” throughcontrol space. The horizon line user interface is evocative of the ADI(attitude deviation indicator) flight instrument, sometimes called theartificial horizon.

Web Site as Central Menu Screen

In the three-click navigation method of the invention, the second clicknavigates from the central menu screen to the content page. In oneembodiment, the central menu screen (level two) is a web page, which maybe designed for distance viewing of interactive television (“ten footexperience”). The web page may be originally designed for the ten footexperience, or may be a reformatted version of a web page that wasoriginally designed for close up viewing. Markup language programmingtechniques and semi-automated procedures for reformatting web pages,such as hypertext markup language (HTML) transcoders, are well known inthe art.

The invention provides a method for redesigning a web site originallydesigned for conventional PC viewing. Basic steps for adapting atraditional web page to serve as a content page in the three-clicknavigation method include:

-   -   Identify and extract the essential features of the web page;    -   Disaggregate these features into data objects, preferably using        metadata;    -   Reformat the data objects (such as tiles, lists, etc) as        graphical objects having a form and layout suitable for distance        viewing, based upon the design techniques of the invention; and    -   Revise and reposition text and graphics within the data objects        suitably for distance viewing.

The reformatting of data objects utilizes three dimensional data objectsand/or animated data objects. Display formats widely used in designingweb sites for the one-foot experience, such as a large number of tightlypacked graphic tiles with “busy” text and images, must be redesigned forthe ten foot experience. Generally the web site is redesigned to displayfewer graphical objects, and three dimensional data objects and/oranimated data objects are used to provide additional surfaces and viewsto display text and graphical content in a format that is suitable forviewing from a distance.

Preferably also the revision and repositioning of text and graphicsincludes repositioning text and/or detailed graphics in a threedimensional and/or animated data object for optional display or displayin magnified form. Generally paragraphs of text should be broken up intosmaller passages, and font sizes less than 16 points should be avoided.

These design rules provide a more uniform look and feel for thenavigation interface, whether the central menu screen is based upon anoriginal design, or a web site redesign. Examples of adaptations oftraditional PC web pages based upon these design techniques includeseparating crowded text and graphics of tiles in the PC web page intoeasily recognizable graphics on the tiles' front, with more involvedtext accessible via turn and zoom of the tiles; reconfiguring long,involved lists in the web page into entries on a wheel that can rotateto prominently display given list entries; and changing a scrolling webpage to stacked pages with navigation aids to leaf through pages or jumpto a desired page.

FIG. 17 shows a web site 500 with typical design characteristics forpersonal computer viewing. The site 500 is a website aggregator thatallows users to find sites providing online video content. The coreelements are a series of tiles 502 used for video site discovery. Eachof these tiles 502 including graphics (e.g. a logo) with embedded linksat a top portion, and site information on a bottom portion. The tilesare tightly packed with information, and abutted against each other in amanner characteristic of web sites designed for “lean in” viewing. Along categories list 504 runs along the left side of the site,categorizing included sites according to niche content. Elements forvideo search include are a text search box 506 and an area 510 for buzzword searches. The site also includes a sorting bar 512 for arrangingdisplayed tiles 502, and banner advertisements 516.

FIG. 18 shows a web site 540 based on the site 500 of FIG. 17,redesigned for the ten foot experience following the design principlesof the present invention. Several inessential elements are omitted. Thetiles 542 are separated with fewer shown on the screen, and the contenton the front of the tile 542 is limited to the graphics and site name.To view the additional textual data that has been removed from the frontof the tile 542, it is necessary to turn over a tile using the turnfunction. The long list is redesigned as a short list object 544 with alimited number of prominent entries, using animation to scan up or downthe list. As a result of these various adaptations, the elements of theredesigned site appear in a simplified arrangement emphasizinggraphics-rich content that is easily viewed from a distance.

In addition to simplified, graphic rich elements, the redesigned website 540 elements can include three-dimensional data objects.Three-dimensional data objects can include multiple display surfaceswith additional displayable information, initially hidden in thedisplay. The three dimensional data objects can be animated objects, inwhich an additional action (click action) by the user reveals theadditional displayable information using the zoom, turn, or leaffunction. Examples of such three dimensional, animated data objects areshown in FIGS. 22 and 23.

In addition to using these design rules for a central menu screen basedupon a web page, the design rules can be used for a web page serving asa content page (third level of the “three click” navigation interface).

The design rules for the redesigned web page 540 also can take intoaccount the layout and content of the hot zones and any extended zones,particularly where the iTV designer seeks to integrate the “look andfeel” and organization of the corner (launch) elements with the centralmenu screen elements. Thus these design rules can be used for web pageshosted by an iTV site based upon the navigation interface of theinvention, as well as for web pages of partner web sites that embody the“look and feel” of the central menu screen of this navigation interface.

Interactive Television Hardware and Software

Interactive television according to the invention may be embodied in avariety of platforms—networked, open, and connected. Examples are IP TV(networked), Internet Television (open) and Cable Television(connected).

IP TV (Internet Protocol Television) is a system in which digitaltelevision service is delivered using Internet Protocol over a networkinfrastructure, which may include delivery by a broadband connection. InIP TV, instead of television being delivered through traditionalbroadcast and cable formats, it is received by the viewer through thetechnologies used for computer networks. A typical IP TV service isdelivered over a so-called walled garden network, which is engineered toensure bandwidth efficient delivery of vast amounts of multicast videotraffic. IP TV's discrete service provider networks typically require aspecial IP TV set-top-box.

Internet television is television distributed through the Internet. Theprimary models for Internet television are streaming Internet TV, andselectable video on an Internet location, typically a website. Internettelevision videos can also be broadcast with a peer-to-peer network,which doesn't rely on single website's streaming. Using Internettelevision, viewers can choose the show they want to watch from alibrary of shows.

Cable television employs fixed optical fibers or coaxial cables asopposed to the over-the-air method used in traditional televisionbroadcasting. Cable television signals use only a portion of thebandwidth available over coaxial lines, leaving space for other digitalservices such as broadband internet. Broadband internet over coaxialcable uses cable modems to convert the network data into a digitalsignal that can be transferred over coaxial cable.

FIG. 16 is a schematic diagram of a software stack 600 for an IP TV,Internet television, or other devices (with suitable adaptations of thedrivers and codecs depending on the device). The software stack of FIG.16 enables users to seamlessly operate and move content and data betweendevices that incorporate the GUI of the invention e.g. in a similarsoftware stack.

Illustrative drivers and codecs, and operating system, may be based uponthe Linux Operating System. The runtime environment is a virtual machinestate which provides software services for processes or programs while acomputer is running. An example of a runtime environment is Adobe AIR,of Adobe Systems Incorporated, San Jose Calif.

The graphical user interface of the invention is built upon thesesoftware elements, and serves as an application platform. The top layerof the software stack is an expandable application layer.

The expandable application layer, with examples of related content,includes:

-   -   Audio-video player, e.g. for media encoded in H264, WMV, and        MPEG-4 codecs    -   WiFi wireless access    -   RSS Feed Reader for subscription to web feeds of interest to the        viewer, such as social networking sites, traffic and weather        information, etc.    -   Widgets, small desktop applications that use the principle of        skinning, such as widgets compatible with the Yahoo! Widget        Engine of Yahoo, Inc, Sunnyvale Calif.    -   Search engines, including video search engines such as that of        Truveo, Inc. San Francisco Calif.    -   Browser, including player plug-in and JAVA applet plug in (Java        is a registered trademark of Sun Microsystems, Inc, Santa Clara        Calif.). The browser can be used for example to access video        aggregator sites    -   File manager, which can be used for personal content such as        video, audio and photographs    -   Concierge—travel and entertainment application    -   Utilities, including device controls, inputs, and device utility        applications    -   Software Development Kit (SDK)

The expandable application layers include a variety of applications andutilities for searching and discovery of content, for requesting content(for download or play), and for playing content. The iTV graphical userinterface of the invention naturally and efficiently combines televisionand video applications with a wide variety of other applications such associal networking, widgets, etc. in an interactive television that iswell-suited to the ten foot experience. A professional iTV systemmanager can aggregate and organize content in curated content menus.Additional applications can easily be added to the application layer,while the iTV's GUI scheme aids a system manager in organizing content.This organization also facilitates user access to various types ofcontent, such as professionally produced programming (e.g. via in-linelinking), user-generated content, locally-stored personal content, etc.

The graphical user interface can easily be downloaded and installed onmultiple user devices, such an interactive television and a hardwaremedia player to provide a uniform GUI across these devices. Aninexperienced user can transfer personal content from another device tothe iTV for playback or display using the tools described above.

Although the invention has been shown and described with respect to acertain preferred embodiment or embodiments, it is obvious thatequivalent alterations and modifications will occur to others skilled inthe art upon the reading and understanding of this specification and theannexed drawings. In particular regard to the various functionsperformed by the above described elements (components, assemblies,devices, compositions, etc.), the terms (including a reference to a“means”) used to describe such elements are intended to correspond,unless otherwise indicated, to any element which performs the specifiedfunction of the described element (i.e., that is functionallyequivalent), even though not structurally equivalent to the disclosedstructure which performs the function in the herein illustratedexemplary embodiment or embodiments of the invention. In addition, whilea particular feature of the invention may have been described above withrespect to only one or more of several illustrated embodiments, suchfeature may be combined with one or more other features of the otherembodiments, as may be desired and advantageous for any given orparticular application.

1. A method of controlling a television, the method comprising:providing a line and a user-movable object (cursor) on a layoutdisplayed on the television; and increasing a control function when theuser-movable object is on one side of the line, and decreasing thecontrol function when the user-movable object is on the other side ofthe line.
 2. The method of claim 1, wherein a rate of increasing and/ordecreasing the control function is a function of a distance between theuser-movable object and the line.
 3. The method of claim 2, furthercomprising displaying a rate indicator on the layout that provides avisual indicator of the rate of increasing and/or decreasing of thecontrol function.
 4. The method of claim 2, further comprising the usermoving the user-movable object using a handheld controller.
 5. Themethod of claim 2, further comprising displaying an indicator of thecontrol function.
 6. The method of claim 5, wherein the indicator is anumerical indicator.
 7. The method of claim 5, wherein the indicator isa graphical indicator.
 8. The method of claim 1, further comprising anadditional line for altering an additional control function.
 9. Themethod of claim 8, wherein the lines are substantially parallel to oneanother.
 10. The method of claim 1, wherein the line is a substantiallyhorizontal line.
 11. The method of claim 1, wherein the line is asubstantially vertical line.
 12. The method of claim 1, wherein thecontrol function includes one or more of channel, volume, contrast,brightness, backlight level, hue, and saturation.
 13. The method ofclaim 1, wherein the line and the object are parts of three-dimensionalcontrol matrix for simultaneously controlling up to three controlfunctions.
 14. The method of claim 13, wherein the line has an illusionof depth into and/or out of the television, further comprising a depthcue associated with the line.
 15. The method of claim 14, furthercomprising a substantially horizontal line and a substantially verticalline.
 16. The method of claim 14, wherein the depth cue comprises aplurality of planes of different sizes, arranged in linear perspectivewith the line having an illusion of depth.